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19. An interface device for enabling a user to spatially navigate a displayed .graphical 
menu with a displayed graphical pointer, the graphical menu having a plurality of menu 
elements, and for enabling said user to more easily select a menu element from said graphical 
menu by_ providing tactile feedback to said user when said graphical pointer i$ moved from one 
menu element to the next menu element in said graphical menu, said interface device 
comprising: 

fa*) a handle to be manipulated manually bv a user in at least two planar degrees of 
freedom: 

(b) a z-axis actuator generating tactile sensations to be felt bv.said user, wherein said 
axis actuator applies forces to the user's hand only along a z-axis degree of freedom when current 
is flowed through a portion of said actuator, said z-axis degree of freedom being different from 
and substantially perpendicular to said two planar degrees of freedom: 

(c) a sensor that produces a locative signal responsive to and corresponding with the 
motion of said handle in said at least two degrees of freedom: 

(&l a button that produces a status signal in response to being pressed bv said user: and 

fel an embedded microprocessor local to said interface device and coupled to said sensor, 
to said button, and to said actuatarysaid microprocessor performing: 

sending handle movement data and button data to a host computer over a communication 
bus such that said host computer can update displayed pointer locations with respect to said 
displayed graphical menu, 

receiving desired force values from said host computer, said desired force values 
correlated with parliailarpointer locations displayed by said host computer, and 

controlling said z-axis actuator in accordance with said received desired force values so 
as to provide said tactile sensations to said user that are correlated with the location of said 
displayed graphical pointer displayed within said graphical mmu. 



20. An interface device as recited in claim 19 wherein said z-axis actuator imparts said 
tactile sensations upon said handle along a z-axis orthogonal to said at least tw o degrees of 
freedom, 

21, An interface device as recited in Haitn 1 9 wherein hand} * is physica lly coupled 
to a support TnrehaTii sm that is grounded and allows linear displacement between said handle and 



22. An interface device as recited in claim 19 wherein said sensor is an optical sensor 
that includes an emitter and a detector. 
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23. An interface device as rec ited in ^laim 22 w herein said emitter moves when said 
handle is moved, projecting light upon said detector. 

24. An interface device as recited in claim 23 wherein said detector detects motion of 
said emitter in two mutually perpendicular directions. 

27. An interface device as recited in daim further comprising a memory that stores 
values that are representative of the locationsjofimages displayed bv said host computer, 

28- An interface, device as recited in claim 27 wherein said locations include the 
locations of icons displayed bv said host computer. 

29. An interface device as recited in claim 19 wherein said handle is a joystick. 

30. An interface device as recited in claim 1 9 wherein said handle is a mouse. 




31. An interface device as recited in claim 19 wherein sai d microp rocessor receives 
display information from said host computer over said communication bus. 



32. An interface device as recited in claim 19 wherein said tactile sensations include a 
viscous drag force. 

33. An interface device as recited in claim 19 wherein said tactile sensations include an 
attractive force. 

34. An interface device as recited in claim 33 wherein said attractive force is used to 
assist a user in positioning^sai ^ display ed pointer into said graphical menu. 

37. An interface device as recited in claim 19 wherein said z-axis actuator is a flat coil 
actuator. 

38. An interface device as recite ** in rJai m 37 wherein the magnet associated with said at 
least one flat coil actuator is fixed with respect to said origin and whe rein the co il moves with 
respect to said origin. 

An interface device as recited in claim 19 wherein said microprocessor receives code 
over a communication bus from a host computer and executes said code. r^mmiinicgtinn bus 
including a serial interface bus. 
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Please cancel claim 40 without prejudice. 

41 . A device for use in conjunction with a host computer including a computer display, 
said host computer displaying a graphical environment including a displayed graphical pointer 
controlled by a user* said device comprising: 

a handle to be manipulated manually bv said user in at least two planar degrees of 
freedom; 

a 2-axis actuator to generate a tactile sensation to be felt bv said user, said z-axis actuator 
applying forces to the user's hand oidy_alo_ngL_a z-axis degree of freedom when current is flowed 
through a portion of said actuator, said z-axis degree of freedom being different from and 
substantially perpendicular to said two planar degrees of freedom: 

a sensor that produces a locative signal responsive to and corresponding with a position 
or motion of said handle in said at least two degrees of freedoms 

a button that produces a status signal in response to being pressed bv said user: and 
control electronics local to said device and coupled to said sensor and said actuator and 
said button, said control electronics performing the following: 

sending handle movement data and button data to said host computer over a 
communicatio n bus such that said host computer can update a displayed pointerlocation in said 
displayed graphical envir onment, 

receiving a force value from said host computer, said force value correlated with said 
updated displayed pointer location^and 

controll in g said z-axis actuator in accordance with said received force value so as to 
provide said tactile sensation to said user that is correlated with the location of said displayed 
graphical pointer displayed within said displayed graphical environment, 

42. A device as recited in claim 54 wherein said microcontroller runs a program 
contained^, at least in part in memory coupled to said microcontroller, and wherein said memory 
also stores location information which corresponds with image data from a computer display 
coupled to said host computer. 

A3. A device as recited in claim 42 wherein said location infonn ^^n includes 
jTtfnr niarion relating to the location of an icon on said graphical display. 

44. A device as recited in claim 42 wherein said location information includes 
information relating to the location of a window on said graphical display, 

45. A device as recited in claim 42 wherein said location information includes 
information relating to the location of a graphical button on said graphical disnlav- 

4 

Received from < 4084671901 > at 2/25/02 1:59:22 PM [Eastern Standard Time] 




# 

FEB. 25. 2002 11:1 2AM IMMERSION NO. 355 P. 7 



46. A device as recited in claim 42 wherein said ima ges include a cursor interacting with 
another object displayed on said computer display. 

47. A device as recited in claim 46 wherein said cursor interacts with an icon image 
displayed on said computer display; 

Please cancel claim 48 without prejudice. 

49. A device as recited in claim 41 wherein said at least two degrees of freedom are 
planar, linear degrees of freedom, % 

SL A device as recited in claim 41 wherein said control electronics calculates force 
feedback forces based on commands received from said host computer. 

52. A device as recited in claim 41 wherein said handle is moveable in a plane. 

53. A device as recited in claim 52 wherein said handle is also moveable along a z-axis 
that is approximately perpendicular to said plane, 

54. A device as recited in claim 41 wherein said control electronics include an embedded 
microcontmjler, 

55. A device as recited, in claim 41 wherein said tactile sensation is applied to correspond 
with said displayed pointer interacting with a displayed graphical menu to enable said user to 
more easily select a menu item from said displayed graphical menu bv providing tactile feedback 
to said user when said displayed graphical pointer is moved from one menu item to a next menu 
item in said graphical menu. 

56. A device as recited in claim 41 wherein said tactile sensation is applied to correspond 
with said displayed pointer interacting with a displayed button. 

57. A device as recited in claim 41 wherein said tactile sensation is applied to correspond 
with said displayed pointer interacting with a displayed window. 

58. A device as recited in claim 41 wherein said tactile sensation is ap plied to correspond 
with said displayed pointer interacting with a displayed icon. 

59. An interface device for use with a h ftfit comp uter displaying a graphical app lication 
on a display device, said host computer displaying executing, and updating graphical obj ects in a 



Received from < 4084671901 > at M02 1 :59:22 PM [Eastern Standard Time] 



FEB. 25. 2002 1 1:12AM IMMERSION 



NO. 355 P. 8 




graphical environment in response to us er mam'pi dation of said interface device and commanding 
force, feedback sensations in response to said user manipula tion and in coordination with said 
graphical objects, said, graphical objects including a graphical pointer, the interface device 
comprising: 

a physical object grasped and manipulatable bv a user in two planar degees of freedom: 

at least one z-axis actuator coupled to said physical object for receiving a force control 
signal and imparting forces along at least one degree of freedom of said physical obiect and in 
accordance with said force control signal, said forces applied along a z-axis degree of freedom 
that is different from and substantially perpendicular tn gain , two planar degrees of freedom: 

a sensor that detects motion of said physical object along said at least one degree of 
freedom and outputs signals relating to the position of said physical object: 

a user-adjustable switch apparatus providing a state signal representing a state of said 
switch apparatus: and 

a microprocessor local to said interface device, separate from said host computer, and 
coupled to said host computer, to said sensor, and to said switch apparatus, said microprocessor 
receiving 

force values from said host computer, said force values correlated with particular 
locations of said graphical pointer in said graphical environment displayed bv said host 
computer, 

said state ai'frriAl frnm said switch apparatus, and 
said signals from said sensor. 

said microprocessor executing a process in parallel with said host execution of 
said graphical application and providing said force control signal to said at least one 
actuator to impart said forces in accordance with said received force values so as to 
provide tactile sensations to said user that are correlated with the location of said 
displayed graphical pointer. 

60. The interface device claimed in claim 59 wherein said graphical objects include a 
displayed graphical menu, wherein said tactile sensations enable said user to more easily select a 
menu element from said displayed graphical menu bv provi Hin^ Ra i'fi tactile sensations to said 
user when said graphical pointer is moved from one menu element to the next menu element in 

63. A method for con trftHiTifr * force feedback interface device using a host computer, 
said interface device manipulated bv a user, a display device coupled to said host computer 
displaying a graphical user interfac&Jp Hnrii'rip images and updating said graphical user interface 
in response to said manipulation of said interface device, said interface device conveyin g force 
feedback sensations to said user in response to said manipulations, the method comprising: 
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.rending a posi tion signal to said host computer, said posit ion signal including information 
rapmgftnt ative of the motion or position r>f a hand le of said interface device in two planar degrees 
of freedom said handle being physically manipulated by said user, wherein said h ost computer 
updates the location of a cursor within said graphical user interface in response to said position 
signal; 

receiving a force value from said host computer with a microprocessor lo cal to said force 
feedback interface device, said force value correlated with said location of sa id cursor: and 

mrrfmnin ff a z-axis actuator in accordance with said received force value to provide a 
tactile sensation to said user that is correlated with said location ofsaid cursor in said graphical 
user interface, said tactile sensation being applied to the user's hand along a z-axis degree of 
freedom, said z-axis degree of freedom being different from and substantially perpendicular to 
said two p lanar deg rees of freedom. 




64. A method as recited tn claim 63 wherein a sensor signal is input to said 
microprocessor, said microprocessor calculating said position s ign*! halt ed on said sensor signal, 
said microprocessor sending said position signal to_said host computer, 

65. A method as recj teri m nlai m 63 wherein said_handle includes a joystick that can be 
moved bv said user in two degrees of freedom. 

66. A method as recited in claim 64 wherein said graphical user interface provides 
graphical objects for interfacing with an application program running on said host computer, said 
graphical objects including_an icon, a window, and a menu. 



Please cancel claims 67-75 without prejudice. 



76. A human-computer interface device for controlKng a graphical cursor displayed bv a 
host computer and for providing tactile feedback to a user in accordance with displayed 
interactions between said cursor and other graphical objects displayed bv said host computer. 
said interface device comprising: 

a physical object to be moved bv a user in two planar degrees of freedom; 

one or more sensors that produce a locative signal responsive to and indicative of the 
position of said physical object in said two planar degrees of freedom: 
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a z-axis actuator that applies force to the user's hand only along a z-axis degree of 
freedom when current is flowed through a portion of said actuator, said 2-axis degree of freedom 
hp.inp; differ ent from and substantially perpendicular to said two planar degr ees of freedom: and 

a microprocessor separate from and m communication with said ho st computer, said 
microprocessor coupled to said sensor and to said actuator^ wherein said m icroprocessor receives 
desired force values from said host computer* said desired force values correlated with particular 
pointer locations displayed by said host computer, said microprocessor c ontrolling current 
through said portion of said actuator in accordance with said received force values. 

77. An interface device as recited in claim 76 wherein said two planar deg rees of 
freedom are x and v axes parallel to a flat surface on which said interface d evice rests and said z- 
axis degree of freedom is substantially perpendicular to said x and v axes. 

78. An interface device_as recited in claim 76 wherein said interface device is a mouse 
device and wherein said physical object is a mouse, 

79. An interface device as recited in claim 76 wherein said actuator includes a wire coil 
through which said current is flowed. 

80. An interface device as i^ited_in_cla irn 79 w herein said actuator includes a magnet 

\^ Y core - 

81. An interface device as recited in claim 80 wherein said magnet c ore is an E-core. 

82. An interface device as recited in claim 76 wherein said sensor is an optical sensor^ 

83. An interface device as recited in claim 82 wherein said sensor is an encoder. 

84. An interface device as recited in claim 80 further comprising a permanent spring 
coupled between said physical object and said actuator. 

85. An interface device as recited in claim 76 wherein said actuator is c ontrolled to 
indicate when the cursor displayed on the host computer is moved from one displayed menu 
element to another displayed menu element 

86. An interface device as recited in claim 76 wherein said actuator is controlled to 
indicate when the cursor displayed on the host computer crosses a window boundary. 

87. An interface device as recited in claim_76 wherein said actuator is controlle d to apply 

said force to said uspt'*; hand to indicate when the cursor displayed on the host computer is 
positioned over a graphical element 
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8_8_._ An interface device as recited in claim 76 wherein said actuator includes a_pNOrtioit 
that i$ moveable bv said user along a 2-axis to provide z-axis control to said host computer. 

Please cancel claims 89-91 without prejudice. 

92. An interface device as recited in claim 76 wherein a physical tactile element is 
physically coupled to said actuator and is moved to contact and apply pressure to said user's 
hand. 




93. An interface device as recited in claim 92 wherein said physical tactile element 
applies pressure upon the user's hand_by pressing upward on said band when said current is 
flowed through said portion of said actuator. 



Please cancel claims 105-108 without prejudice. 
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